m 

3 

o 



LU 



(19) 



J 



Europaisches Patentamt 
European Patent Office 
Office europeen des brevets 



(12) 



(45) Date of publication and mention 
of the grant of the patent: 
13.11.2002 Bulletin 2002/46 



(11) EP 1 074 904 B1 

EUROPEAN PATENT SPECIFICATION 

(51) IntClJ: G05D 1/03 



(21) Application number: 00306523.2 

(22) Date of filing: 31 .07.2000 



(54) Lateral control of vehicle for lane following 

Seitliche Steuerung zum Folgen einer Fahrspur 
Controle laterale pour ie suivi d'une voie 



(84) Designated Contracting States: 
DE FR GB 

(30) Priority: 02.08.1999 JP 21917199 

(43) Date of publication of application: 
07.02.2001 Bulletin 2001/06 

(73) Proprietor: NISSAN MOTOR COMPANY, LIMITED 
Yokohama-shi, Kanagawa 221-0023 (JP) 

(72) Inventors: 

• Satoh, Shigeki 

Chigasaki-shi, Kanagawa 253-0082 (JP) 

• Uenuma, Kenya 

Yokosuka-shi, Kanagawa 237-0063 (JP) 



• Mouri, Hlroshi 

Yokohama-shl, Kanagawa 236-0028 (JP) 

• Furusho, Hiroyuki 
Kanagawa (JP) 

• Shimakage, Masayasu 
Yokosuka-shi, Kanagawa 237-0063 (JP) 

(74) Representative: Godwin, Edgar James 
MARKS & CLERK, 
57-60 Lincoln's Inn Fields 
London WC2A 3LS (GB) 

(56) References cited: 
EP-A- 0 527 665 



Note: Within nine months from the publication of the mention of the grant of the European patent, any person may give 
notice to the European Patent Office of opposition to the European patent granted. Notice of opposition shall be filed in 
a written reasoned statement. It shall not be deemed to have been filed until the opposition fee has been paid. (Art. 
99(1) European Patent Convention). 



Printed by Jouve, 75001 PARIS (FR) 



1 

Description 

[0001] The present invention relates generally to a 
driver assistance system for facilitating steering of a ve- 
hicle by tracking a target line on the surface of a road- 
way, and more particularly to a lateral control of a vehicle 
for lane-following system based on detection of lane 
markings (usually painted white or yellow lines) on the 
surface of a roadway. 

[0002] A number of technologies for lateral control by 
detection of lane markings have emerged. Some of such 
technologies are disclosed in US-A 5 913 375, US-A 5 
765 1 1 6 and US-A 5 979 581 . In US-A 5 91 3 375 a CCD 
camera mounted on a vehicle detects the presence of 
lane markings on a roadway and carries out lateral con- 
trol of a vehicle in relation to the detected lane marking. 
In US-A 5.765 116 a video camera or a CCD camera is 
used to detect the presence of lane marking. An asso- 
ciated signal processor estimates the vehicle lateral po- 
sition in relation to the detected lane markings. An elec- 
tric motor coupled to the steering mechanism is used to 
provide a torque input to the steering. A controller is de- 
signed to assist the driver to maintain the vehicle lane 
position using a torque input to the steering. In US-A 5 
979 581 a laser sensor is used to detect three points on 
a painted lane marking on the surface of a roadway and 
three points are used to estimate the position of the lane 
centerline relative to the vehicle, as well as the geometry 
of the roadway. 

[0003] JP-A 1 0-1 03935 discloses a technology to es- 
timate a curve of a lane in a road constructed with a 
slope rising to the outside edge by correcting image from 
an image pick-up mounted on a vehicle. This technology 
is used to correctly estimate the lane centerline used for 
vehicle lateral control for lane following. 
[0004] Most of these technologies relay on the lane 
centerline for lateral control of a vehicle. Some of drivers 
may feel uneasy or uncomfortable at being deviated 
from their favorite lane positions if they are guided to- 
ward the lane centerline. Therefore, a need remains for 
a new approach to the lateral control of vehicles, which 
allow drivers favorite lane positions. 
[0005] EP-A-0 527 665 discloses a system and a 
method in accordance with the pre-characte rising part 
of claims 1 and 7. 

[0006] An object of the present invention is to provide 
an automated lane-following system which allows driv- 
ers favorite lane positions. 

[0007] According to one aspect of the present inven- 
tion, there is provided a lane-following system for facil- 
itating steering of a vehicle by tracking a lane of a road- 
way, as set forth in claim 1 . 

[0008] The invention will be fully understood by refer- 
ence to the following drawings, which are for illustrative 
purposes only: 

[0009] Figure 1 is a functional block diagram of an au- 
tomated lane-following system in accordance with the 
present invention. 
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[001 0] Figure 2 is a diagrammatic view of a hardware 
configuration of an automated lane-following system in 
accordance with the present invention. 
[001 1 ] Figure 3 is a flow chart of a control routine im- 
5 plementing the present invention. 

[0012] Figure 4 is a plan view of a lane defined by lane 
markings, illustrating the operation of the present inven- 
tion. 

[0013] Figure 5 is a timing diagram illustrating the op- 
io eration of the present invention. 

[0014] Figure 6 is a timing diagram illustrating the op- 
eration of the present invention. 

[0015] Figure 7 is a timing diagram illustrating the op- 
eration of the present invention. 

15 

DESCRIPTION OF THE PREFERRED 
EMBODIMENTS 

[001 6] For illustrative purposes, the present invention 
will be described with reference to Figure 1 through Fig- 
ure 7, where like reference numerals denote like parts, 
and the method may vary as to the steps and their se- 
quences, without departing from the basic concept as 
described herein. 

[0017] Referring first to Figure 1, a functional block 
diagram of an automated lane-following system employ- 
ing the present invention is shown. The system compris- 
es a look-ahead sensor 98 mounted on a vehicle 100, 
and a steering controller 12. The steering controller 12 
comprises a feedforward control module 106, a feed- 
back control module 1 08, a lateral displacement correc- 
tion module 1 1 0, a limit criteria module 1 1 2, a target line 
update module 114, and a logic module 130. It will be 
appreciated from the discussion herein that steering 
controller 12 and each of the modules included therein 
would typically be implemented in software on a com- 
puter, but hardware and/or firmware implementations 
are also contemplated. 

[0018] Look-ahead sensor 98 is a conventional sys- 
tem including a CCD camera 11 and an associated im- 
age processor 102. The CCD camera 11 is mounted on 
the vehicle, for example, in the middle of the bonnet or 
grille, or in the vicinity of the internal rear view mirror, in 
order to detect the presence of lane markings on a road- 
way, for example the spaced white or yellow lines defin- 
ing a lane. Image processor 102 acquires images from 
CCD camera 11 and estimates the position of a lane 
centerline in relation to the lane markings and the lateral 
displacement Yn of vehicle 100 inwardly of a lane from 
one of the lane markings. The estimated lane centerline 
and lateral displacement position signals are fed to 
steering controller 12 together with an "ACCEPT sig- 
nal. Image processor 102 monitors the image signals 
from CCD camera 1 1 and switches the "ACCEPT' signal 
between "1" level and M 0" level. If look-ahead sensor 98 
locates the lane markings, the "ACCEPT 1 signal is at 
the "1" level. The "ACCEPT" signal is otherwise at the 
"0" level. This "ACCEPT signal is used in determining 
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whether or not look-ahead sensor 98 has detected the 
lane markings. 

[0019] The logic module 130 is designed to produce 
a two-level signal having a first level that allows auto- 
mated steering control for lateral control and a second 5 
level that prohibits such automated steering control. 
This two-level signal from the logic module 130 is ap- 
plied to feedforward and feedback control modules 1 06 
and 108. In response to the first level of this two-level 
signal, feedforward and feedback control modules 1 06 10 
and 108 are operative to perform their functions. In re- 
sponse to the second level of the two-level signal, feed- 
forward and feedback control modules 1 06 and 1 08 are 
disabled. The two-level signal from logic module 130 is 
also applied to lateral displacement database, limit cri- 15 
teria, and target line update modules 110, 112, and 114. 
In response to the first level of the two-level signal, these 
modules 110,112, and 1 1 4 are disabled. These modules 
110, 112, and 114 are operative to perform their func- 
tions when a is met under a condition when the second 20 
level of the two-level signal is present. 
[0020] Feedforward control module 106 produces a 
feedforward steering term based on the target line from 
target line update module 114. The target line and the 
lateral displacement are fed to a summation point 1 04 25 
to produce a lateral error between the lateral displace- 
ment from the target line. Feedback control module 1 08 
produces a feedback steering term based on the lateral 
error from summation point 104. The feedforward and 
feedback terms combine to produce a steering control 30 
signal for the desired front steering angle, which is sent 
to a steering actuator (not shown in Figure 1 ) on vehicle 
1.00. 

[0021] Steering controller 12 responds to the signals 
from look-ahead sensor 98 and produces a steering 35 
control signal of greater or lesser magnitude to provide, 
in turn, a greater or smaller bias to the steering system 
depending upon the lateral error of the vehicle from the 
target line. The actuator coupled to the steering mech- 
anism is used to provide a torque input to the steering 40 
which may either assist or oppose the steering torque 
from the vehicle driver. 

[0022] The steering bias applied by the lane-following 
system can be switched on and off by the use of an au- 
tomated lane-following selector switch 13 on a driver in- 45 
terface 120 that may have a display 122. 
[0023] The lane-following system is first switched on 
by operation of selector switch 13 and display 122 indi- 
cates that this has occurred. The system then searches 
the lane markings. While the system is doing this, the so 
message on display 122 reads "searching". As soon as 
the system locates the lane markings, display 122 indi- 
cates "accept". If the lane marking is lost, display 122 
returns "searching" until it again locates the lane mark- 
ing with display 122 returning to "accept". 55 
[0024] Logic module 130 in response to the "AC- 
CEPT' signal monitors whether or not look-ahead sen- 
sor 98 has detected lane markings. If the "ACCEPT" sig- 



nal is at "1" level, it is determined that detection of lane 
marking is present. If it is at "0" level, detection of lane 
markings is absent. Logic module 1 30 monitors also the 
position of selector switch 13. It holds the two-level sig- 
nal at its first level in response to presence of detection 
of "ACCEPT" signal when selector switch 13 is turned 
on. The two-level signal assumes its second level when 
selector switch 13 is turned off. 

[0025] Referring to Figure 4, image processor 1 02 ac- 
quire image signals from CCD camera 11 and estimates 
the position of a lane centerline between left-hand and 
right-hand lane markings in terms of a lateral distance 
from the left-hand lane marking. Image processor 102 
estimates also a lateral displacement from the left-hand 
lane marking of a point Yn at a preview distance in front 
of a vehicle. 

[0026] Let us now consider the case where a driver 
wishes to be guided along the lane centerline. In this 
case, immediately after the drive switches on lane-fol- 
lowing system through selector switch 13, the lane cen- 
terline is set as the target line that is tracked by the ve- 
hicle. 

[0027] Let us now consider the case where a driver 
tends to steer a vehicle by tracking a leftwardly deviated 
line from the lane centerline or rightwardly deviated line 
from the lane centerline as the best lane position. The 
lane-following system according to the present inven- 
tion can learn such a deviated line by collecting lateral 
displacement at number of times when the driver travels 
on a roadway by tracking a lane at his best lane position. 
The deviated line given by the learning is set as a target 
line for the subsequent vehicle lateral control got lane 
following. 

[0028] Referring again to Figure 1, in a lateral dis- 
placement collection mode when selector switch 13 is 
turned off, lateral displacement database module 110 is 
operative to collect lateral displacement Yn from image 
processor 1 02 at a number of times within a predeter- 
mined period or time To and determines average Yopt* 
that can be expressed as: 

Yopt* = 1/n (Y1 + Y2 + ... + Yn). 

[0029] The absolute value Yopt* is confined to a pre- 
determined window around the estimated lane center- 
line at limit criteria module 112. Referring to Figure 5, 
lateral displacements Ymax and Ymin define the bound- 
ary of the window. If the estimated lane centerline is ex- 
pressed in terms of a lateral displacement Yc, Ymax and 
Ymin can be expressed as: 

Ymax = Yc + AW, 



Ymin = Yc - AW, 
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where: AW is an allowable deviation from Yc. 
Thus, estimated lateral centerline Yc determines Ymax 
and Ymin. At limit criteria module 112, Ymax is set as 
Yopt* if IYopt*l > Ymax, while Ymin is set as Yopt* if 
lYopt*! < Ymin. The average Yopt* as modified is set to 
target line update module 114. At target line update 
module 114, target line Yopt is updated with Yopt* from 
limit criteria module 112. 

[0030] From the preceding description, it is under- 
stood that a leftwardly or rightwardly deviated target line 
may be set during lateral control for lane keeping as il- 
lustrated in Figure 5, so that a driver can take his/her 
lane position. 

[0031] Figure 2 illustrates an automated lane-follow- 
ing system according to the present invention. The ref- 
erence numeral 100 designates a vehicle having a 
steering system. A steering wheel 1 is connected for uni- 
tary rotation with an upper shaft 2a of a steering shaft 
2. A lower shaft 2b is coupled with upper shaft 2a via a 
universal joint 3. Within a rack and pinion type steering 
gear box 4, lower shaft 2b has at Its lower end a pinion 
(not shown) which is in meshing engagement with a pair 
of side rods 5 that are operatively connected with front 
right and left road wheels, respectively. 
[0032] A wheel gear 6 is fixedly coupled with upper 
shaft 2a at a portion near its lower end. An actuator in 
the form of a motor 7 is mounted adjacent upper shaft 
2a and has a worm 8 in meshing engagement with wheel 
gear 6. An electromagnetic clutch 9 is disposed between 
motor 7 and worm 8. A drive of motor 7 is transmitted to 
worm 8 to apply steer bias to the steering system. 
[0033] A steer angle sensor 10, which is attached to 
an upper portion of upper shaft 2a, detects angular po- 
sition of upper shaft 2a relative to its neutral position. It 
generates a steer angle signal 0 indicative of the detect- 
ed angular position. Steer angle signal 8 is fed to a steer- 
ing controller 12, which is a conventional microcomputer 
based control unit including, as usual, a central proces- 
sor unit (CPU), a random access memory (RAM), a read 
only memory (ROM), an input output device (I/O), and 
an internal clock. The CPU, RAM, ROM, and I/O are in- 
terconnected by data bus. Controller 1 2 shown in Figure 
2 is substantially the same as its counterpart in Figure 
1 , but it performs the function of the image processor 
102 of Figure 1. 

[0034] Steering controller 12 has an actual steer an- 
gle calculation module implemented in software and 
stored in the ROM. Using this software, the CPU derives 
actual steer angle 0d from angular displacement 9 and 
steering gear ratio. Image signals from a CCD camera 
1 1 are fed to controller 1 2. CCD camera 1 1 is mounted 
on a vehicle 100 in the vicinity of the internal rear view 
mirror in order to detect the presence of lane markings 
on a roadway. Controller 12 has an image processor 
module implemented in software and stored in the ROM. 
Using this software, controller 1 2 estimates the position 
of a lane centerline in relation to the lane markings and 
the lateral displacement Yn of vehicle 1 00 from one of 



the lane markings. The position of the lane centerline is 
expressed in terms of a lateral displacement from the 
lane marking. Controller 12 monitors the image signals 
from CCD camera, 11 and sets an "ACCEPT" signal at 
5 "1" level if CCD camera 11 locates the lane markings. 
Controller 12 sets the "ACCEPT" signal at "0" level if 
CCD camera 1 1 loses or is searching the lane markings. 
[0035] A torque sensor 1 4, such as disclosed in EP 0 
555 987 B1 , comprises a compliant element in the upper 
10 portion of upper shaft 2a in the vicinity of steer angle 
sensor 10 in order to detect torsional angle <}> of upper 
shaft 2a either optically or inductively. The detected tor- 
sional angle <J> represents driver input torque through 
steering wheel 1 . A signal indicative of the detected tor- 
's sional angle $ is fed to controller 12. Controller 12 has 
an actual steer torque calculation module implemented 
in software and stored in the ROM. Using this software, 
controller 1 2 derives actual steertorque Td from torsion- 
al angle 4>. 

20 [0036] The lane-following system can be switched on 
and off by a driver through an automated lane-following 
selector switch 13. When the lane-following system is 
switched on, controller 1 2 keeps on determining a target 
value in operation parameter such as steer torque or 

25 steer angle. If steer torque is used as the operation pa- 
rameter, steer angle sensor 1 0 and the actual steer an- 
gle calculation module may be omitted. In this case, con- 
troller 12 determines a target steer torque Tr based on 
the estimated position of target line and the lateral dis- 

30 placement from the lane marking. It produces a steering 
control signal of magnitude to provide, in turn a torque 
input to the steering which may assist or oppose the 
steering torque from the driver, whereby the actual steer 
torque Td approaches the target steer torque Tr. In re- 

35 sponse to the steering control signal, electric current 
passing through motor 7 is regulated to provide such 
torque input to the steering. If steer angle is used as the 
operation parameter, torque sensor 14 and the actual 
steer torque calculation module may be omitted. In this 

40 case, controller 1 2 determines a target steer angle Topt 
in response to the position of target line and the lateral 
displacement from the lane marking. It determines a 
steering control signal. In response to the steering con- 
trol signal, motor 7 provides a torque input to the steer- 

^5 ing which may either assist or oppose the steering 
torque from the driver, such that a deviation of actual 
steer angle Gd from target steer angle Topt approaches 
zero. 

[0037] The flow chart of Figure 3 is a control routine 

50 implementing the present invention. 

[0038] At step S30, the CPU inputs information from 
the signal processor module. The information includes 
lane centerline position between lane markings defining 
a lane, lateral displacement Yn from one lane marking 

55 and "ACCEPT signal. 

[0039] At step S31 , the CPU determines whether or 
not automated lane-following selector switch 13 is 
turned on. If switch 1 3 is turned on, at step S31 , the rou- 
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tine proceeds to step S32. If, at step S31 , the switch 13 
is turned off, the routine proceeds to step S35. 
[0040] At step 32, the CPU inputs a target line Yopt, 
that is expressed in terms of a lateral position from the 
lane marking, out of a target line memory, and It inputs 5 
a target deviation AY out of a target deviation memory. 
[0041] At the next step S33, the CPU determines a 
target value in operation parameter of the steering sys- 
tem, such as a target steer torque Tr and a target steer 
angle Topt, in such a direction as to reduce an error be- to 
tween lateral displacement Yn and the target line (Yopt 
+ AY) toward zero. 

[0042] At step 533, the CPU determines and outputs 
a steering control signal indicative of current passing 
through electric motor 7. Motor 7 provides a torque input 
to the steering in response to the electric current in such 
a manner as to bring actual steer torque Td into agree- 
ment with target steer torque Tr or actual steer angle 8d 
into agreement with target steer angle Topt. 
[0043] If, at step S31 , the CPU determines that select- 20 
ed switch 13 is turned off, the routine proceeds to step 
S35. At step S35, the CPU determines whether or not 
the vehicle travels in a lateral displacement collection 
mode. 

[0044] Based on the recognition that lane positions 25 
selected by different drivers will not differ appreciably 
upon passing through a curve of a roadway, one stand- 
ard of judgment, which may be used at step S35, is 
whether or not a radius of curve of the estimated lane 
centerline is sufficiently great. In other words, it is judged 30 
whether or not a roadway is generally straight. Other 
standard of judgment is whether or not yaw rate angle 
is less than a predetermined angle. 
[0045] If, at step S35, the CPU determines that the 
vehicle travels in the lateral displacement travels in the 35 
lateral displacement collection mode, the routine pro- 
ceeds to step S36. At step S36, the CPU stores current 
lateral displacement Yn (n = 1 , 2, 3, ...) in a lateral dis- 
placement memory RGS. 

[0046] At next step S37, the CPU increases the con- 40 

tent of timer T by one (T = T + 1 ). 

[0047] At step S38, the CPU determines whether or 

not timer T is greater than a predetermined time value 

To. 

[0048] As long as T < To at step S38 and the interro- 45 
gation at step S35 is affirmative, the CPU repeats oper- 
ation to store lateral displacement Yn in lateral displace- 
ment memory RGS. Thus, lateral displacement memory 
RGS collects or stocks lateral displacement data. 
[0049] If, at step S35, the CPU determines that the 50 
vehicle travels outside of the lateral displacement col- 
lection mode. The routine proceeds to step S44 and 
then to step 545. At step S44, the CPU resets timer T 
equal to zero (T = 0). At step S45, the CPU clears lateral 
displacement memory RGS (RGS = 0) before returning ss 
to START point. 

[0050] If, at step 538, the CPU determines that T is 
greater than or equal to To (T ^ To), the routine pro- 



ceeds to step S39. At step 539, the CPU inputs all of the 
lateral displacement data Y1 , Y2, + ... + Yn from the lat- 
eral displacement memory and determines an average 
Yopt* by calculating the following equation: 

Yopt* = (1/n) (Y1 + Y2 + ... + Yn). 

Next, the routine proceeds to step S40. At step S40, the 
CPU determines whether or not the absolute value of 
Yopt* is less than or equal to a predetermined maximum 
Ymax. If this is the case, the routine proceeds to step 
S48. At step S48, the CPU determines whether or not 
the absolute value of Yopt* is greater than or equal to a 
predetermined minimum Ymin. If this is the case, the 
routine proceeds to step S43. At step S43, the CPU up- 
dates the target line Yopt stored in the target line mem- 
ory with Yopt*. Referring to Figure 4, the predetermined 
maximum and minimum Ymax and Ymin define limits of 
an allowable deviation range from the estimated lane 
centerline. In this example, the predetermined maxi- 
mum and minimum Ymax and Ymin can be expressed 
as, 

Ymax = Yc + AW, 



Ymin = Yc - AW, 

where: 

Yc is lateral displacement of lane centerline, and 
AW is maximum deviation. 

If IYopt*l > Ymax, the interrogation at step S40 results 
in negative and the routine proceeds to step S42. At step 
S42, the CPU sets Ymax as Yopt* before the routine 
proceeds to step S43. If IYopt*l < Ymin, the interrogation 
at step S48 results in negative and the routine proceeds 
to step S49. At step S49, the CPU sets Ymin as Yopt* 
before the routine proceeds to step S43. 
[0051] After the CPU has overwritten the target line 
Yopt at step S43, the routine proceeds to steps 44 and 
45 before returning to START point. 

Automated Steering During Lateral Control for Lane 
Following 

[0052] If selector switch 13 is turned on to select lat- 
eral control for lane following, a flow along steps S30, 
S31, S32, S33 and S34 is repeated. At step 534, the 
CPU outputs steering control signal. In response to this 
steering control signal, electric current passing through 
motor 7 is regulated. Motor 7 provides a torque Input to 
the steering in such a direction as to bring actual steer 
torque Td into agreement with target steer torque or ac- 
tual steer angle Gd into agreement with target steer an- 
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gle Topt. In this manner, the vehicle is guided toward the 
target line. 

Updating Target Line 

[0053] Learning is conducted to obtain preferred lane 
position taken by a driver to provide a target line reflect- 
ing the driver's preferred lane position. This target line 
is used to overwrite the preceding target line. Subse- 
quently, lateral control using this new target line is con- 
ducted. 

[0054] Learning is initiated after driver has turned off 
selector switch 13. In this case, the interrogation at step 
S31 stays negative, allowing the routine to proceed 
along steps S35, 536, S37, and S38 as long as T < To 
and the lateral displacement collection mode is satis- 
fied. Lateral displacement Yn is stored in lateral dis- 
placement memory RGS. This operation is repeated un- 
til T becomes equal to or greater that To. If, at step S38, 
it is determined thatT ^ To, the routine proceeds to step 
S39 and then to step S43. At step S43, the CPU over- 
writes the existing target line with a new target line cre- 
ated based on the data obtained at step S39. 

Conditions Permitting Rewriting Target line 

[0055] It is not that lateral displacement is always col- 
lected for producing a new target line when selector 
switch 13 is turned off. Unless the lateral displacement 
collection mode is accomplished (see step S35), the lat- 
eral displacement is not collected even when selector 
switch 13 is turned off (see step S31). 
[0056] At step S35, what may be required as standard 
for judgment is whether or not a radius of curve of a road- 
way is sufficiently great. If the radius of curve of the road- 
way is sufficiently great, indicating that the roadway is 
generally straight, lateral displacement is stored for pro- 
ducing a new target line. 

[0057] Figure 5 illustrates variation of lateral displace- 
ment Yn collected for a historical reference time To im- 
mediately after the lateral displacement collection mode 
has begun. The average Yopt* of these lateral displace- 
ment data is used to rewrite target line Yopt. 
[0058] Individual favorite lane positions by drivers are 
not reflected when a vehicle travels along a curve. Lat- 
eral displacements obtained during such travelling con- 
dition are not used in producing a target line. According- 
ly, rewritten target lines Yopt correspond to individual fa- 
vorites of drivers. 

Allowable Deviation Range of Target Line 

[0059] Referring to Figure 4, rewritten target line is 
confined within the allowable deviation range from the 
lane centerline between lane markings. This may be 
confirmed by reviewing steps S40, S42, S48, and S49 
in Figure 3. In the example of Figure 4, the maximum 
deviation AW is 0.1 if the width of a lane is 1 .0. 



[0060] Accordingly, excessive deviation from the lane 
centerline is prohibited. 

[0061] Figures 6 and 7 illustrate another feature that 
may be added to the preceding embodiment illustrated 
in Figures 2 to 5. According to this feature, driver steer- 
ing torque from Td is always detected during lateral con- 
trol for lane following. Immediately after a torque data 
collection mode has been accomplished when a vehicle 
travels on a generally straight roadway, time integral 
ZTd of detected driver steering torque Td is calculated. 
This calculation continues for a historical reference time 
until ZTd exceeds a preset threshold value Tth. Upon 
elapse of the historical reference time, the average of 
steering torque data obtained during the historical ref- 
erence time is calculated. Target deviation AY is altered 
upon elapse of the historical reference time (see Figure 
7) in such a direction as to reduce the calculated aver- 
age of steering torque toward zero. 
[0062] In this manner, during lateral control for lane 
following, updating AY causes a reduction in driver 
steering torque needed to hold a vehicle at a target line. 
As a result, should the driver release the steering wheel, 
the vehicle will be held at the driver favorite lane posi- 
tion. 

[0063] In the example of Figures 6 and 7, the driver 
steering torque Td is used. The driver steering torque 
may be replaced with steering control signal. In this 
case, the average of steering control signal data collect- 
ed during a historical reference time is calculated. Upon 
elapse of the historical reference time, the target devia- 
tion AY is updated in such a direction as to reduce the 
calculated average of steering control signal data to- 
ward zero. 

[0064] In this manner, during lateral control for lane 
following, updating AY causes a reduction in driver 
steering torque needed to hold a vehicle at a target line. 
As a result, should the driver release the steering wheel, 
the vehicle will be held at the driver favorite lane posi- 
tion. 



Claims 

1 . A lane-following system for facilitating steering of a 
vehicle by tracking a lane of a roadway, the lane- 
following system comprising: 

means (98) for detecting the position of lane 
marking on the surface of a roadway in relation 
to the vehicle, the lane marking defining a lane 
of a roadway, the said means (98) being oper- 
ative^ coupled to means (12) for estimating a 
lateral displacement (Yn) of a point at a preview 
distance in front of the vehicle from the detect- 
ed lane marking; 

actuating means (7), coupled to a steering 
mechanism, for providing a steering bias to a 
steering system, which may either assist or op- 
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pose steer torque from a driver, in response to 
a steering control signal; and 
control means (12) for producing the steering 
control signal based on the estimated lateral 
displacement (Yn) to assist the driver to main- 
tain the vehicle at a target line within the lane 
using steering bias, 

characterised in that: 



5. A system as claimed in any preceding claim, where- 
in, during lateral control for lane following, the con- 
trol means (12) is operable to update a target devi- 



ation from the target line upon elapse of a historical 
reference time in such a manner as to reduce to- 
ward zero the average of the steering control signal 
data collected within the historical reference time. 

6. A method of facilitating steering of a vehicle by 
tracking a lane of a roadway, the method compris- 
ing: 

detecting the position of lane marking on the 
surface of a roadway in relation to the vehicle, 
the lane marking defining a lane of a roadway; 
estimating a lateral displacement of a point at 
a preview distance in front of the vehicle from 
the detected lane marking; 
producing a steering control signal based on 
the estimated lateral displacement to assist a 
driver of the vehicle to maintain the vehicle at 
a target line within the lane using a steering bi- 
as; and 

providing a steering bias to a steering system, 
which may either assist or oppose steer torque 
from the driver, in response to the steering con- 
trol signal; 

characterised by the steps of 

(a) when the vehicle travels without lateral con- 
trol for lane following, determining whether or 
not the current travelling condition of the vehi- 
cle is appropriate for the purpose of collecting 
the estimated lateral displacement for produc- 
tion of lateral displacement data, 

(b) when it is determined that the current trav- 
elling condition of the vehicle is appropriate for 
the said purpose under a condition where the 
vehicle travels without lateral control for lane 
following, collecting the estimated lateral dis- 
placement within a historical reference time to 
provide the lateral displacement data, 

(c) calculating an average of the lateral dis- 
placement data based on the estimated lateral 
displacement collected within the historical ref- 
erence time, and 

(d) updating the position of the target line using 
the average of the lateral displacement data. 

Patentanspruche 

1. Fahrspur-Verfolgungssystem zum Erleichtem ei- 
nes Lenkens eines Fahrzeugs durch Folgen einer 
Fahrspur einer StraBe, wobei das Fahrspur-Verfol- 
gungssystem umfasst: 

eine Einrichtung (98) zum Erfassen der Positi- 
on einer Fahrspurmarkierung auf der Oberfla- 
che einer StraBe in Bezug auf das Fahrzeug, 



(a) the control means (12) is operable, when 
the vehicle travels without lateral control for 
lane following, to determine whether or not the 
current travelling condition of the vehicle is ap- 
propriate for the purpose of collecting the esti- 1$ 
mated lateral displacement (Yn) for production 

of lateral displacement data, 

(b) the control means (12) is operable, when it 
is determined that the current travelling condi- 
tion of the vehicle is appropriate for the said 20 
purpose under a condition where the vehicle 
travels without lateral control for lane following, 

to collect the estimated lateral displacement 
(Yn) within a historical reference time to provide 
the lateral displacement data, 25 

(c) the control means (12) is operable to calcu- 
late an average of the lateral displacement data 
based on the estimated lateral displacement 
collected within the historical reference time, 
and 30 

(d) the control means ( 1 2) is operable to update 
the position of the target line using the average 
of the lateral displacement data. 

2. A system as claimed in claim 1 , wherein the control 35 
means (1 2) is operable to determine whether or not 

a deviation of a roadway from straightness is less 
than a predetermined magnitude. 

3. A system as claimed in claim 1 or 2, wherein the *o 
control means (12) is operable to limit a difference 
between the position of the target line and the po- 
sition of the lane centerline within a predetermined 
window set around the lane cenferfine. 

45 

4. A system as claimed in any preceding claim, further 
comprising a torque sensor (14) for detecting steer 
torque from the driver, wherein, during lateral con- 
trol for lane following, the control means (12) is op- 
erable to update a target deviation from the target 50 
line upon elapse of a historical reference time in 
such a manner as to reduce toward zero the aver- 
age of steer torque data collected within the histor- 
ical reference time. 
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wobei die Fahrspurmarkierung eine Fahrspur 
einer StraBe definiert, wobei die Einrichtung 
(98) betriebsmaBig mit einer Einrichtung (12) 
zum Abschatzen einer lateralen Verschiebung 
(Yn) von einem Punkt in einem Vorhersehungs- 
abstand vor dem Fahrzeug von der erfassten 
Fahrspurmarkierung gekoppelt ist; 

eine Stelleinrichtung (7), die mit einem Lenk- 
mechanismus gekoppelt ist, zum Bereitstellen 
einer Lenkvorbelastung an einem Lenksystem, 
die ein Lenkdrehmoment von einem Fahrer 
entweder unterstutzen oder diesem entgegen- 
wirken kann, im Ansprechen auf ein Lenksteu- 
ersignal; und 

eine Steuereinrichtung (12) zum Erzeugen des 
Lenksteuersignals auf Grundlage der abge- 
schatzten lateralen Verschiebung (Yn), um den 
Fahrer zum Halten des Fahrzeugs auf einer 
Ziellinie innerhalb der Fahrspur unter Verwen- 
dung der Lenkvorbelastung zu unterstutzen; 

dadurch gekennzelchnet, dass: 

(a) die Steuereinrichtung (1 2) betreibbar ist, um 
dann, wenn sich das Fahrzeug ohne eine late- 
rate Steuerung fur eine Fahrspur-Verfolgung 
bewegt, zu bestimmen, ob die gegenwartige 
Bewegungsbedingung des Fahrzeugs fur den 
Zweck einer Sammlung der abgeschatzten la- 
teralen Verschiebung (Yn) fur eine Erzeugung 
von Lateralverschiebungsdaten geeignet ist 
oder nicht, 

(b) die Steuereinrichtung (12) betreibbar ist, um 
dann, wenn bestimmt wird, dass die gegenwar- 
tige Bewegungsbedingung des Fahrzeugs fiir 
den Zweck unter einer Bedingung geeignet ist, 
bei der sich das Fahrzeug ohne eine laterale 
Steuerung fur eine Fahrspur-Verfolgung be- 
wegt, die abgeschatzte laterale Verschiebung 
(Yn) innerhalb einer historischen Referenzzeit 
zu sammeln, um die Lateralverschiebungsda- 
ten bereitzustellen, 

(c) die Steuereinrichtung (12) betreibbar ist, um 
einen Durchschnitt der Lateralverschiebungs- 
daten auf Grundlage der abgeschatzten latera- 
len Verschiebung, die innerhalb der histori- 
schen Referenzzeit gesammelt wird, zu be- 
rechnen, und 

(d) die Steuereinrichtung (12) betreibbar ist, um 
die Position der Ziellinie unter Verwendung des 
Durchschnitts der Lateralverschiebungsdaten 
zu aktualisieren. 



2. System nach Anspruch 1 , wobei die Steuereinrich- 
tung (12) betreibbar ist, um zu bestimmen, ob eine 
Abweichung einer StraBe von einem geraden Zu- 
stand geringer ats eine vorgegebene GroBe ist oder 

5 nicht. 

3. System nach Anspruch 1 oder 2, wobei die Steuer- 
einrichtung (12) betreibbar ist, um eine Differenz 
zwischen der Position der Ziellinie und der Position 

10 der Fahrspurmittellinie innerhalb eines vorgegebe- 
nen Fensters, welches um die Fahrspurmittellinie 
herum eingestellt ist, zu begrenzen. 

4. System nach irgendeinem vorangehenden An- 
'5 spruch, ferner umfassend einen Drehmomentsen- 

sor (1 4) zum Erfassen eines Lenkdrehmoments von 
dem Fahrer, wobei wahrend einer lateralen Steue- 
rung fur eine Fahrspur-Verfolgung die Steuerein- 
richtung (12) betreibbar ist, um eine Zielabwei- 

20 chung von der Ziellinie auf einen Ablauf einer histo- 
rischen Referenzzeit hin in einer derartigen Weise 
zu aktualisieren, um den Durchschnitt von Lenk- 
drehmomentdaten, die innerhalb der historischen 
Referenzzeit gesammelt werden, in Richtung auf 

25 Null hin zu verringem. 

5. System nach irgendeinem vorangehenden An- 
spruch, wobei wahrend einer lateralen Steuerung 
fiir eine Fahrspur-Verfolgung die Steuereinrichtung 

30 (1 2) betreibbar ist, um eine Ztelabweichung von der 
Ziellinie auf einen Ablauf einer historischen Refe- 
renzzeit hin in einer derartigen Weise zu aktualisie- 
ren, um den Durchschnitt der Lenksteuerungssig- 
naldaten, die innerhalb der historischen Referenz- 

35 zeit gesammelt werden, in Richtung auf Null hin zu 
verringern. 

6. Verfahren zum Erleichtern eines Lenkens eines 
Fahrzeugs durch Folgen einer Fahrspur einer Stra- 
ta Re, wobei das Verfahren die folgenden Schritte um- 

fasst: 

Erfassen der Position einer Fahrspurmarkie- 
rung auf der Oberflache einer StraBe in Bezug 

45 auf das Fahrzeug, wobei die Fahrspurmarkie- 

rung eine Fahrspur einer StraBe definiert; 
Abschatzen einer lateralen Verschiebung eines 
Punkts in einem Vorhersehungsabstand vor 
dem Fahrzeug von der erfassten Fahrspurmar- 

50 kierung; 

Erzeugen eines Lenksteuersignals auf Grund- 
lage der abgeschatzten lateralen Verschie- 
bung, um einen Fahrer des Fahrzeugs zum 
Halten des Fahrzeugs an einer Ziellinie inner- 

55 halb der Fahrspur unter Verwendung einer 

Lenkvorbelastung zu unterstutzen; 
Bereitstellen einer Lenkvorbelastung an einem 
Lenksystem, die ein Lenkdrehmoment von 



8 



15 



EP 1 074 904 B1 



16 



dem Fahrer entweder unterstutzen oder die- 
sem entgegenwirken kann, im Ansprechen auf 
das Lenksteuersignal; 

gekennzeichnet durch die folgenden Schrit- 5 

te: 

(a) wenn sich das Fahrzeug ohne eine laterale 
Steuerung fur eine Fahrspur-Verfoigung be- 
wegt, Bestimmen, ob die gegenwartige Bewe- io 
gungsbedingung des Fahrzeugs zu dem 
Zweck einer Sammlung der abgeschatzten La- 
te ralversc hi ebung fur eine Erzeugung von La- 
teralverschiebungsdaten geeignet ist oder 
nicht, 15 

(b) wenn bestimmt wird, dass die gegenwartige 
Fahrbedingung des Fahrzeugs fur den Zweck 
unter einer Bedingung, bei der das Fahrzeug 
sich ohne eine laterale Steuerung fur eine Fahr- 20 
spur-Verfolgung bewegt, geeignet ist, Sam- 
meln der abgeschatzten lateralen Verschie- 
bung innerhalb einer historischen Referenz- 
zeit, urn die Lateralverschiebungsdaten bereit- 
zusteilen, 25 

(c) Berechnen eines Durchschnitts der Lateral- 
verschiebungsdaten auf Grundlage der abge- 
schatzten Lateralverschiebung, die innerhalb 

der historischen Referenzzeit gesammelt wird, 30 
und 

(d) Aktualisieren der Position derZiellinie unter 
Verwendung des Durchschnitts der Lateralver- 
schiebungsdaten. 35 



Revendications 

1. Systeme de suivi de voie pour faciliter la direction 40 
d'un vehicule en poursuivant une voie d'une chaus- 
see, le systeme de suivi de voie comprenant: 

un moyen (98) pour detecter la position d'un 
marquage de voie sur la surface d'une chaus- 45 
see en relation avec le vehicule, le marquage 
de voie definissant une voie d'une chaussee, 
ledit moyen (98) etant couple en fonctionne- 
ment a un moyen (12) pour estimer un depla- 
cement lateral (Yn) d'un point a une distance so 
de previsualisation a I'avant du vehicule par 
rapport au marquage de voie detecte; 

un moyen d'actionnement (7), couple a un me- 
canisme de direction, pour appliquer une pous- 55 
see de direction a un systeme de direction, qui 
peut etre soit en assistance, soit en opposition 
par rapport a un couple de direction emanant 



d'un conducteur, en reponse a un signal de 
commande de direction; et 

un moyen de commande (12) pour produire le 
signal de commande de direction sur la base 
du deplacement lateral estime (Yn) afin d'as- 
sister le conducteur dans son maintien du ve- 
hicule selon une ligne cible a I'interieur de la 
voie en utilisant une poussee de direction, 

caracterise en ce que: 

(a) le moyen de commande (12) peut fonction- 
ner, lorsque le vehicule avance sans comman- 
de laterale pour un suivi de voie, pour determi- 
ner si oui ou non la condition d'avancee cou- 
rante du vehicule convient dans le but de col- 
leger le deplacement lateral estime (Yn) pour 
la production de donnees de deplacement la- 
teral; 

(b) le moyen de commande (12) peut fonction- 
ner, lorsqu'il est determine que la condition 
d'avancee courante du vehicule convient pour 
ledit but sous une condition dans laquelle le ve- 
hicule avance sans commande laterale pour un 
suivi de voie, pour collecter le deplacement la- 
teral estime (Yn) dans un temps de reference 
historique afin de produire les donnees de de- 
placement lateral; 

(c) le moyen de commande (12) peut fonction- 
ner pour calculer une moyenne des donnees 
de deplacement lateral sur la base du deplace- 
ment lateral estime collecte dans le temps de 
reference historique; et 

(d) le moyen de commande (12) peut fonction- 
ner pour mettre a jour la position de la ligne ci- 
ble en utilisant la moyenne des donnees de de- 
placement lateral. 

2. Systeme selon la revendication 1 , dans lequel le 
moyen de commande (12) peut fonctionner pour 
determiner si oui ou non une deviation d'une chaus- 
see par rapport a un caractere rectiligne est infe- 
rieure a une amplitude predeterminee. 

3. Systdme selon la revendication 1 ou 2, dans lequel 
le moyen de commande (12) peut fonctionner pour 
limiter une difference entre la position de la ligne 
cible et la position de la ligne centrale de voie dans 
une fenetre predeterminee qui est etablie autour de 
la ligne centrale de voie. 

4. Systeme selon Tune quelconque des revendica- 
tions precedentes, comprenant en outre un capteur 
de couple (14) pour detecter un couple de direction 
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emanant du conducteur, dans lequel, pendant une 
commande laterale pour un suivi de voie, le moyen 
de commande (12) peut fonctionner pour mettre a 
jour une deviation cible par rapport a la ligne cible 
suite a I'ecoulement d'un temps de reference histo- 5 
rique de maniere a reduire en direction de zero ia 
moyenne de donnees de couple de direction qui 
sont collectees dans le temps de reference histori- 
que. 

w 

Systeme selon Tune quelconque des revendica- 
tions precedentes, dans lequel, pendant une com- 
mande laterale pour un suivi de voie, le moyen de 
commande (12) peut fonctionner pour mettre a jour 
une deviation cible par rapport a la ligne cible suite is 
a I'ecoulement d'un temps de reference historique 
de maniere a reduire en direction de zero la moyen- 
ne des donnees de signal de commande de direc- 
tion qui sont collectees dans le temps de reference 
historique. 20 

Proced6 pour faciliter la direction d'un v6hicule en 
poursuivant une voie d'une chaussee, le proc£de 
comprenant: 

25 

la detection de la position d'un marquage de 
voie sur la surface d'une chaussee en relation 
avec le vehicule, le marquage de voie definis- 
sant une voie d'une chaussee; 
Pestimation d'un deplacement lateral d'un point 30 
a une distance de previsualisation a Pavant du 
vehicule par rapport au marquage de voie de- 
tect e; 

la production d'un signal de commande de di- 
rection sur la base du deplacement lateral es- 35 
tim6 afin d'assister un conducteur du vehicule 
dans son maintien du vehicule selon une ligne 
cible a I'interieur de la voie en utilisant une 
poussee de direction; et 

I'application d'une poussee de direction sur un 40 
systeme de direction qui peut etre soit un cou- 
ple de direction assistee, soit en assistance, 
soit en opposition par rapport a un couple de 
direction 6manant du conducteur, en reponse 
au signal de commande de direction, 45 

caracterise par les etapes de: 

(a) lorsque le vehicule avance sans commande 
laterale pour un suivi de voie, determination de so 
si oui ou non la condition d'avancee courante 

du vehicule convient dans le but de collecter te 
deplacement lateral estime pour la production 
de donnees de deplacement lateral; 

55 

(b) lorsqu'il est determine que la condition 
d'avancee courante du v6hicule convient pour 
ledit but sous une condition dans laquelle le ve- 



hicule avance sans commande laterale pour un 
suivi de voie, collecte du deplacement lateral 
estime dans un temps de reference historique 
afin de produire les donnees de deplacement 
lateral; 

(c) calcul d'une moyenne des donnees de de- 
placement lateral sur la base du deplacement 
lateral estime collecte dans le temps de refe- 
rence historique; et 

(d) mise a jour de ia position de la ligne cible 
en utilisant la moyenne des donn6es de depla- 
cement lateral. 
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FIG.3 
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